Cultural Heritage in CLEF
نویسندگان
چکیده
The paper for the CHiC pilot lab describes the motivation, tasks, Europeana collections and topics, evaluation measures as well as the submitted and analyzed information retrieval runs. In its first year, CHiC offered three tasks: ad-hoc, which measured retrieval effectiveness according to relevance of the ranked retrieval results (standard 1000 document TREC output), variability, which required participants to present a list of 12 records that represent diverse information contexts and semantic enrichment, which asked participants to provide a list of 10 semantically related concepts to the one in the query to be used in query expansion experiments. All tasks were offered in monolingual, bilingual and multilingual modes. 126 different experiments from 6 participants were evaluated using the DIRECT system.
منابع مشابه
The Polish Task within Cultural Heritage in CLEF (CHiC) 2013. Torun Runs
This paper presents the goals and realization of a Polish Task for Cultural Heritage in CLEF (CHiC) 2013 campaign. We present a short introduction to Polish language complexity, and problematic issues that may occur during automatic text processing. The organization of a separate ad-hoc task for Polish has been described, as well as collection used for test. We do also describe topics delivered...
متن کاملThe CHiC Interactive Task (CHiCi) at CLEF2013
The interactive task in Cultural Heritage in CLEF 2013 used a standardised interactive protocol, information retrieval system and interface to observe a set of participants remotely via the web as well as in the lab access an English language collection from the Europeana Digital Library. Both user response and log data were collected from the 208 participants.
متن کاملChemnitz at the CHiC Evaluation Lab 2012: Creating an Xtrieval Module for Semantic Enrichment
Cultural heritage is one of the most valuable resources that describe the creative power of mankind. In this article we describe a total number of 96 experiments that have been submitted as contributions to the three subtasks of the Cultural Heritage in CLEF pilot evaluation lab. At the core of the majority of these experiments lies a prototype implementation for semantic enrichment based on DB...
متن کاملSheffield Submission to the CHiC Interactive Task: Exploring Digital Cultural Heritage
The Cultural Heritage in CLEF 2013 (CHiC) interactive task focused on acquiring and analysing interactive information retrieval (IIR) behaviour in a Digital Cultural Heritage collection. The University of Sheffield contributed 120 on-line and 20 in-lab participants to this task. The results of both the on-line and in-lab experiments strongly indicate that when faced with a new, unfamiliar colle...
متن کاملCHiC 2011 - Cultural Heritage in CLEF: From Use Cases to Evaluation in Practice for Multilingual Information Access to Cultural Heritage
Digital libraries and other information systems that access Cultural Heritage (CH) materials are becoming increasingly complex. They must often manage a diverse range of content from different CH institutions – such as libraries, museums, written and audiovisual archives – and have to provide access to them in a unified and coherent way. The content from CH institutions is often multilingual an...
متن کاملCultural Heritage in CLEF (CHiC) 2013 - Multilingual Task Overview
The Cultural Heritage in CLEF 2013 multilingual task comprised two sub-tasks: multilingual ad-hoc retrieval and semantic enrichment. The multilingual ad-hoc retrieval sub-task evaluated retrieval experiments in 13 languages (Dutch, English, German, Greek, Finnish, French, Hungarian, Italian; Norwegian, Polish, Slovenian, Spanish, Swedish). More than 140,000 documents were assessed for relevance...
متن کامل